IIT Kharagpur at TAC 2009: Statistical and Nugget-based Model for Automatic Summary Evaluation

نویسندگان

  • Sushant Kumar
  • Abhijeet Kumar
چکیده

In this paper we present our participation at TAC 2009 AESOP (Automatically Evaluating Summaries Of Peers) task. We make use of a statistical model for evaluation metric correlating to Overall Responsiveness and a nugget-based pyramid model for correlating to the Pyramid manual metric of TAC 2009. We also present the performance of our three submitted runs as per the official TAC 2009 evaluation results.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

IIT Kharagpur at TAC 2008: Statistical Model for Opinion Summarization

In this paper we present our participation at TAC 2008 opinion summarization task. We make use of a statistical model for opinion extraction and the subsequent summarization of the extracted opinions. We also present its performance as per the official TAC 2008 evaluation results.

متن کامل

ICON - 2008 6 th International Conference on Natural Language Processing

A system of machine translation under the framework of transfer-based grammar for Indian languages needs a set of rules for mapping the several syntactic as well as semantic facts of a source language on to the target language representations. Among these critical syntactico-semantic facts, this paper tries to approximate linguistic conditions for mapping rules for Hindi postposition transfer t...

متن کامل

Enhancing N-Gram-Based Summary Evaluation Using Information Content and a Taxonomy

In this paper we propose a novel information-theoretic metric for automatic summary evaluation when model summaries are available as in the setting of the AESOP task of the Update Summarization track of the Text Analysis Conference (TAC). The metric is based on the concept of information content operationalized by using a taxonomy. Hereby, we present and discuss the results obtained at TAC 2009.

متن کامل

A Multi-Objective Method for Network Reconfiguration (TECHNICAL NOTE)

This paper presents an algorithm based on multi-objective approach for network reconfiguration. Multiple objectives are considered for reduction in the system power loss, deviations of the nodes voltage and transformers loading imbalance, while subject to a radial network structure in which all the loads must be energized and no branch current constraint is violated. These three objectives are ...

متن کامل

Thomson Reuters at TAC 2009: ContextChain and Fractional Conditional Compressibility of Models

This paper contains the results for the FastSum system and a simple baseline system for the TAC 2009 main task – update summarization –. For the pilot task of Automatically Evaluating Summaries of Peers (AESOP), we present two novel metrics. The first metric called ContextChain is an extension of a recently proposed metric AutoSummENG that is based on comparing n-gram graphs of the model summar...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2009